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ABSTRACT 

Weak lensing by large-scale structure is a powerful technique to probe the dark components of the 
universe. To understand the measurement process of weak lensing and the associated systematic 
effects, image simulations are becoming increasingly importa nt. For this purpose we p resent a first 
implementation of the Monte Carlo Control Loops [MCCL] jRefregier & Amara|20I4), a coherent 
framework for studying systematic effects in weak lensing. It allows us to model and calibrate the 
shear measuremen t process using image simulations from the Ultra Fast Image Generator (UFiG; 
Berge et al. 2013). We apply this framework to a subset of the data taken during the Science Ver- 
ihcation period (SV) of the Dark Energy Survey (DES). We calibrate the UFiG simulations to be 
statistically consistent with DES images. We then perform tolerance analyses by perturbing the sim¬ 
ulation parameters and study their impact on the shear measurement at the one-point level. This 
allows us to determine the relative importance of different input parameters to the simulations. For 
spatially constant systematic errors and six simulation parameters, the calibration of the simulation 
reaches the weak lensing precision needed for the DES SV survey area. Furthermore, we find a sensi¬ 
tivity of the shear measurement to the intrinsic ellipticity distribution, and an interplay between the 
magnitude-size and the pixel value diagnostics in constraining the noise model. This work is the first 
application of the MCCL framework to data and shows how it can be used to methodically study the 
impact of systematics on the cosmic shear measurement. 

Subject headings: Gravitational lensing: weak — methods: numerical — methods: statistical — 
surveys 


1. INTRODUCTION 

Within the last decades our picture of the Universe 
changed dramatically with the discovery of its acceler¬ 
ating expansion attributed to a mysterious dark energy. 
Together with dark matter they make up the dark sec¬ 
tor of the Universe. The introduction of dark energy has 
led to the establishment of the AGDM-model as the cur¬ 
rent cosmological standard model. The model agrees well 
with observations from different cosmological probes (e. g 
Hinshaw et al. 2013 Planck Gollaboration et al. 2014). 
Nonetheless, understanding the nature of the dark sector 
is one of cosmology’s most pressing challenges. 


Weak gravitational lensin g (for reviews see Refregier^ 
2003 Hoekstra fc Jain|2008 ), a distortion effect of galaxy 
shapes due to interloping structures along the line-of- 
sight, has a large p otential to shed light o nto the mystery 
of the dark sector (Albrecht et al. 2006). It is a purely 
gravitational effect, and thus reacts m the same way to 
dark and baryonic matter. However, the induced distor¬ 
tions on galaxy shapes are very weak (~1%). Therefore, 
galaxy shapes need to be measured to a very high pre¬ 
cision for weak lensing t o unleash its full potential as a 
cosmological p robe (e.g. |Huterer et al.||2006| |Amara & 
Refregier 2008 henceforth ARU8j. 


Many shape-measurement algorithms have been devel- 
oped over the pa st two decades (for an overview see 
Zuntz et al. 2013, and references therein). Image sim- 
ulation plays an important role for calibrating and vali¬ 
dating those methods. To test the performance of vari- 
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ous shear measurement codes on simulated images, pub- 
lie challenges like the Shear TEsting Pr ograms (STEP) 
(Heymans et al.|2006 Massey et al.|2007) an d the GRav- 
itation lEnsing Accuracy 'Testing (GREAT) (Bridle et al. 


2009 Hitching et al.|20T2 Mandelbaum et al.|2014[ ) were 


established. Valuable insight in the measurement process 
could be gained and significant progress was made. How¬ 
ever, these challenges reaffirmed that a careful and rig¬ 
orous treatment of systematic errors is essential to weak 
lensing as a cosmological probe. 

Several large wide-held imaging surveys will come on¬ 
line in the next few years, including the Dark Energy 
Survej0 (DE^, the Kilo Degree Survej0 (KiDS), Hyper 
Suprime-Gan|^ (HSG), EuclicQ and the Large Synoptic 
Survey Telescop^ (LSST). They will map out a large 
fraction of the S^, yielding a wealth of data. In this 
work, we will focus on data from DES. 

In this paper, we present an initial implementation of 
a novel shear measure ment approach, the Mont e Carlo 
Control Loops [MCCL] Refregier & Amara|2014 hence¬ 
forth RA13) at the one-point statistics level. We use 
image simulations that pass through the same lensing 
measurement pipeline as the data to forward model the 
measurement process. In this approach, not only can 
the shear measurement be calibrated, the nature of the 


^ http://www.darkenergysurvey.org/ 

^ http://kids.strw.leidenuniv.nl/ 
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pipeline allows us to test the robustness of the calibra¬ 
tion. The MCCi^framework dynamically modifies the 
leasing pipeline and aims to provide a shear measure¬ 
ment with systematic errors smaller than the statistical 
errors for the survey being considered. For this purpose, 
we establish a set of three iterative Control Loops (CL) 
which build upon each other. First, the simulations are 
tuned to be statistically consistent with data. Second, 
the leasing measurement is calibrated. Third, the ro¬ 
bustness of the calibration is tested. We achieve this by 
perturbing the simulation parameters and recalibrating 
the measurement while keeping data and simulations sta¬ 
tistically consistent. The uncertainty in the calibration 
due to the perturbed parameters gives the systematic 
error of the measurement. 

This paper is organized as follows. In Section we 
explain the main concept and requirements in using the 
MCCL framework to tackle the shear measurement prob¬ 
lem. In Section 1^ we give a description of the DES SV 
data. The main ^tures of UFiG are described in Section 
1^ We focus especially on the properties of the simulated 
galaxies, PSF, noise, and the shear field. In Section 
we present the MCCL framework and its implementa¬ 
tion. We show in Section different diagnostics of our 
calibrated image simulations for DES. Furthermore, the 
results of our first tentative analysis of the robustness 
of the shear measurement calibration are presented. We 
conclude in Section 0 

2. MCCL AND THE SHEAR MEASUREMENT PROBLEM 

The main goal of this paper is to tackle the weak leas¬ 
ing shear measurement problem using the MCCL ap¬ 
proach proposed by RA13. In this section we elaborate 
on the main concepts behind the MCCL framework and 
how that translates into the specific implementations (see 
Section!^ carried out in this paper. 

The first key concept is that all the CLs need to be 
specifically “controlled” by certain criteria, or targets. 
For example, in our first CL, we define criteria within 
which we view the simulations and the data to be sta¬ 
tistically consistent. When the simulations satisfy the 
requirements, we leave the loop and continue on to the 
next step. The overall target that controls the entire 
framework is naturally tied to the science goals of the 
framework. In our case, the target is producing shear 
measurements that are accurate within statistical errors 
of the DES dataset of interest. 

We choose to set the main target of this paper using 
results from AR08. First, we parametrize our measured 
shear to be linearly related to the true underlying shear 
via 

7f^ = (l + m,)7-+Q + IV, (1) 


its stated. This can be thought of as the requirements 
for the case of spatially constant systematic effects. 

Following the logic above, the second key concept 
is that the MCCL framework is problem- and survey- 
specific. The targets are set by the problem of inter¬ 
est, and the CLs are designed to achieve this sole target. 
This suggests that conclusions drawn from applying the 
MCCL approach should not be readily applied to differ¬ 
ent problems. For example, in this paper our goal is the 
measurement of shear one-point functions. Therefore, 
the results presented in this work are not appropriate 
to answer questions regarding two-point measurements 
of shear (e.g. spatial correlation of the shear measure¬ 
ments). A new MCCL framework with different target 
values and diagnostics will need to be designed for each 
particular question. 


3. THE DARK ENERGY SURVEY 

DES is a wide-held optical imaging survey that will 
cover 5000 deg^ in the Southern Sky during its 5 years of 
operation and will record information of over 300 million 
galaxies. The survey area overlaps with other surveys 
such as the South Pole Telescop^(SPT) and the Visible 
and Infrared Survey Telescope tor Astronomy (VISTA) 
Hemisphere SurvejQ (VHS). Focusing on Type la Super¬ 
novae, Baryon Acoustic Oscillations, galaxy clusters, and 
weak gravitational lensing as main cosmological probes, 
DES aims to study the nature of dark energy. The in¬ 
strument achieved hrst light on 2012 September 12 and 
the main science survey officially started on 2013 August 
12 . 

Imag es are taken with the D ark Energy Camera (DE- 
Cam; |Flaugher et al.||2012|, designed specihcally for 
DES. The camera is mounted on the Blanco-4m telescope 
at Cerro Tololo Inter-American Observatory in Chile. 
DECam provides 0.27"/pixel resolution. Good seeing on 
this site ranges between 0.7" and 1.1". 

In this work, we will test our method using a fraction 
of the SV-Al release, which covers ~200 deg^. Single 
exposures that were stacked to coadded images (straight 
averages), whose raw data are publicly available, were 
processed by the DES Data Management pipeline ver¬ 
sion “SVAl” (Yanny et ah, in preparation). The images 
were taken during the SV period, which lasted between 
2012 November and 2013 February. For this work, we se¬ 
lected images covering ~50 deg^ in the SPT-E field that 
are free of significant image artifacts. We demonstrate 
our MCCL method on one image with an area of ~0.5 
deg^, DES0441-44Hj while using the rest of this SPT-E 
subsample to derive the statistical errors. The area is 
sufficiently large and contains enough stars and galaxies 
for the simulations to be calibrated to this image. 


where 7 * is the true shear, 7 °^® the estimated shear, nii 
and Ci are the multiplicative and additive biases, and 
N is a noise term that averages out for large numbers. 
Then, according to AR08, in order for the shear measure¬ 
ment not to be systematics-dominated, we would require 
TO, < 0.025 and c, < 1.65 • for a DES SV-like 200 
deg^ survey, and to^ < 0.005 and Ci < 0.75 • 10“^ for 
the full 5000 deg^ DES survey. While these upper lim¬ 
its were derived by AR08 for two-point statistics, they 
place requirements on one-point statistics, namely that 
the absolute means of to^ and Ci must stay below the lim¬ 


4. ULTRA FAST IMAGE GENERATOR (UFIG) 

In this paper we analyze images simulated with UFiG 
(Berge et al. 2013 henceforth B13). The image genera¬ 
tion process consists of two steps. First, galaxy and star 
catalogs are generated. Then, the catalogs are turned 
into a coadded image. A brief overview of the proper¬ 
ties of the UFiG-generated galaxy catalogs, the PSF and 
noise models, and the shear field is given below, while 


® http://pole.uchicago.edu/ 
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a full description can be found in B13. Note that some 
of the models used in B13 are not fully realistic, but 
they provide a good starting point. The output from our 
MCCL framework would inform us if more sophisticated 
models are needed to describe the data. 

The MCCL approach typically requires the simulation 
and analysis of many thousands of images. Thus, speed 
is crucial. In order not to be dominated by the image 
generation, its speed needs to be at least comparable 
to the analysis. Due to several computational optimiza¬ 
tions, UFig is orders of magnitude faster than publicly 
available image simulators. In terms of runtime, generat- 
ing an image is compara ble to executing SExtractor 
(Bertin & Arnouts|1996 henceforth SE) on the same im- 
age, which sets the time scale in the MCCL framework. 

A key property of UFig is its flexibility in adjusting 
to different telescope setups. In this paper we choose to 
model r-band coadded images taken by DECam, but it is 
straightforward to simulate images from other wide-held 
imaging surveys. 

4.1. Calaxies 

A galaxy is simulated in UFig by sampling its light 
distribution photon-by-photon, and is then placed with 
a uniform probability on the image. Due to the hnite 
number of photons sampled, the simulated galaxy images 
naturally include Poisson noise. PSF convolution in this 
approach is simply a displacement of the photons drawn 
from a prob abil ity distribution in the shape of the PSF 
(see Section 4.3). We model the galaxy light distribution 
with a single-Sersic proHle to which we apply a distortion 
to generate the apparent ellipticity. 

The radial prohle is dehned by a Sersic index, an in¬ 
trinsic magnitude and an intrinsic size. The latter two 
are non-trivially correlated. We parametrize and sample 
this distribution in a space, where magnitudes and sizes 
are approximately uncorrelated {magr, log rso^r)- It is 
related to the magnitude and size plane (mag, log r^o^i) 
through a rotation by an angle 0 around a pivotal point 
{magp, log rso.p), i.e. 


mag \_ cos 0 sm 0 \ magr \ / iTiagp 

log rso,* J ~ l^-sin 0 cos0J l^log r 5 o,r ) \log r^o^p 

( 2 ) 

We parametrize the distribution of rotated galaxy in¬ 
trinsic half-light radii rso.r- with a log-normal distribu¬ 
tion with rms dispersion cr. The distribution of rotated 
magnitudes magr is approximated by the distribution of 
intrinsic magnitudes mag shifted by magp, which was 
compiled by B13 from different ground- and space-based 
surveys. In other words, we assume the cumulated mag¬ 
nitude distribution to be approximately invariant under 
the rotation described in Eq. This is a good approxi¬ 
mation for small values of the rotation angle 0. The two 
parameters 0 and a, the compiled cumulated magnitude 
distribution, and the pivotal point uniquely describe the 
two-dimensional distribution in the magnitude-size plane 
for our modeled galaxy sample. The Sersic index dis¬ 
tribution was derived by fitting single-Sersic profiles to 
different galaxy samples in B13. 

The intrinsic gala xy ellipticities are defined by (see e.g. 
Rhodes et al.||2000 ) 


where Cj are the unweighted quadrupole moments of the 
galaxy’s light profile and ei, 62 are the two components 
of the ellipticity. In this paper, we sample ei and 62 
separately from normal distributions with mean zero and 
rms dispersion ei^rms and 62 ,rms- 

4.2. Stars 

Since stars are typically brighter than galaxies, it 
is optimal to simulate them pixel-by-pixel rather than 
photon-by-photon. They are simulated directly on the 
image pixel grid and also placed on the image with a 
uniform probability. The profile is given by the PSF 
inte grate d within each pixel of the image grid (see Sec¬ 
tion 4.3). Poisson noise is included by drawing a value 


from the corresponding Poisson distribution in every 
pixel. 

To simulate a star, only a magnitude needs to be 
drawn. We sample a cumulated magnitude distribution 
derived from the stellar p opulation synthesis model Be- 
sangon (Robin et al. 2003). In case the resulting intensity 
in a pixel is larger than DECam’s saturation threshold, 
bleeding is modeled. 

4.3. PSF 

In this initial implementation of the MCCL frame¬ 
work we choose as a baseline for future work a spatially 
constant, elliptical Moffat profile to describe the PSF. 
The elliptical Moffat profile can be derived from a two- 
dimensional linear transfo rmation of th e circular Moffat 
profile, which is given by (Moffat|[l969) 


J(r) = 


(l+(5)' 


( 4 ) 


— I2 


2M 


e = ei +162 = 


( 3 ) 


where the scale parameter a is related to the seeing. The 
profile is defined by the seeing, the exponent /?, and the 
ellipticities ei and 62 - We find that the radial profile 
of stars in coadded DES images roughly follow a Moffat 
distribution with some variation in the parameters a and 

P- 

In this initial implementation we choose for simplicity 
to fit a spatially invariant PSF to the image of interest 
{DES0441-44Mj see SectionIS) in a pre-calibration step. 
We use in this work a PSF ot FWHM 1.09", ellipticity 
ei = 0.035, 62 = 0.02, and /3 = 3.5 to match the mean 
PSF of this image. Note that this PSF size is slightly 
larger than the projected median seeing of the main sur¬ 
vey (~0.9"). As shear measurement is more challenging 
with larger PSF sizes, we expect our MCCL framework 
to produce results similar or better on an image with 
better seeing conditions. 

4.4. Nois 6 

Two different components add to the noise in UFig. 
First, we simulate galaxies down to magnitudes r ~ 29. 
Since most of these faint galaxies are not detected, every 
image contains sky noise arising from many unresolved, 
faint galaxies. Second, we add a Gaussian background 
noise centered around 0 with a constant rms dispersion 
un across the image. This should capture noise induced 
by emission from the sky, and noise induced by the data 
processing. We perform furthermore Lanczos resampling 
(Duchon 1979) with a kernel of width five pixels and a 















4 


Bruderer et al. 


half-a-pixel offset on the simulated pixel grid. It allows 
us to mimic correlated noise in real images, while bypass¬ 
ing the expensive simulation and data reduction of raw 
images (see B13). 


4.5. Shear field 

We employ the following shear conventions in UFiG 
and throughout this pap er (Rhodes et al. 2001 Bartel- 
mann fc Schneider||2001 ) 


7i = 2 (^1 “ ^2) ^ and 72 = did 2 ' i >, 


( 5 ) 


where 4' is the projected lensing potential. 

To be close to real surveys, we use a ACDM shear 
power spectrum and model the shear field as a Gaussian 
random field. We choose i7o = 70 km s“^ Mpc“^, = 
0.3, r^A = 0.7, as = 0.8. We simu late Gaussian random 
fields with Lang & Potthoff (2011 )’s fast algorithm. 


5. METHOD 

The MCCL framework is designed to validate the shear 
measurement process on simulated images and to test its 
robustness. RA13 identify three key iterative steps in the 
shear measurement process, which are labeled as Control 
Loops (CL), each with a distinct goal. 

The first step (CLl) is designed to find a fiducial con¬ 
figuration of simulation parameters such that the simula¬ 
tions agree with the data. In order to quantify the level 
of agreement, this step relies on defining a set of diagnos¬ 
tics and metric targets. The next step {CL2) is to cali¬ 
brate the shear measurement at this fiducial point. The 
final and computationally most demanding step {CL3) 
aims to explore the parameter space volume for which 
data and simulations are in good agreement to ensure 
that the calibration scheme from CL2 is robust. This 
scheme is designed to ensure that the systematic errors 
on a given shear measurement are sub-dominant to the 
statistical errors. Should the results of CL3 show that 
the employed calibration scheme is not robust enough 
over all parameter space allowed by CLl, then the whole 
MCCL framework needs to be applied again with more 
stringent diagnostic requirements and possibly additional 
diagnostics. 

It is clear now that in order to assess the robustness 
of this calibration scheme the generation and analysis of 
many tens or even hundreds of thousands of images is 
required. From a computational viewpoint this is only 
feasible if every step is very fast. This echoes our state¬ 
ment in Section on the importance of using UFiG as 
our main image simulation tool. 

The detailed implementation of each of the CLs is pre¬ 
sented below. 


5.1. Control Loop 1 

To make statements about the consistency of data and 
simulations output, we analyze three distributions de¬ 
scribed below as our main diagnostics. To assess how 
likely it is that two different distributions of data and 
simulations could be different realizations of the same 
underlying model, we use a y^-method. We apply ap¬ 
propriate cuts to the three diagnostic distributions and 
bin them. This allows us to compute for each diagnos¬ 
tic and combine them by adding them up. For a number 


of different diagnostic distributions #Diag, the total y^^^ 
for two binned da tasets of different sizes is given by (e.g. 
Press et ar]|2002 ) 


Xrerf 




EkNk 


i=i j=i 


'd,ij 




( 6 ) 

Here, for the i-th diagnostic distribution of the real (sim¬ 
ulated) image, fij [gij) is the number of counts in the 
j-th bin. Ni bins is the number of bins for this diagnos¬ 
tic with counts fij above a certain threshold, and fi (gi) 
is the sum of all counts in those bins. er,^ ij and (Ts,ij 
are the errors of the data and the simulation for the i-th 
diagnostic distribution within the j-th bin. The errors 
need to be estimated in the data and the simulations. 
For the data, we estimate them by computing the vari¬ 
ance in those bins for all the images in the sample. For 
the simulations, we generate many different realizations 
of the same input model and compute the variances in 
every bin. For this y^-method the variables in each bin 
should follow a Gaussian distribution. We therefore only 
include bins with at least 50 objects (about 36000 ob¬ 
jects are detected in the real image). We find this to be 
a good approximation. 

For this first implementation, we choose three diagnos¬ 
tics to break the degeneracies between the parameters we 
vary. They are refined iterative ly t o meet the require¬ 


ments to pass CLS (see Section 5.3). Two of the three 


diagnostics use SE estimators. A comparison of the per- 


lormance or certain estim 
in (e.g. iBertin & Arnouts 

a,tors 

1996 

on tnese imag 
Chang et al. 

es IS snown 
in prepara- 

tion, 2(J14 

and references 

therein). 'I'he three diagnostics 


are: 


• Histogram of pixel values in ADUs (Fig. [^: ID 

This is a valuable diagnostic to test the background 
properties of the image by comparing the peak of 
the distribution in the sky-subtracted images. Fur¬ 
thermore, it allows us to test the magnitude zero 
point of the image. Different magnitude zero points 
shift the tail of the large pixel values vertically, as 
they affect the number of pixels with small respec¬ 
tively large pixel values. 

• Binned magnitude versus size-plane (Fig. |^: 2D 

This diagnostic probes the magnitude and size 
distributions of identified objects in the im¬ 
ages and their correlation. We use the SE 
columns MAG_BEST for the magnitude and 
FLUX_RADIUS for the size. 

• Binned ei versus e 2 -plane in three different magni¬ 
tude bins (Eig. |^: 2D 

This tests the ellipticity distribution of identified 
objects. We estimate the ellipticity using a ver¬ 
sion of Eq. [^with weighted quadrupole moments. 
We split the objects up into three different mag¬ 
nitude bins, each containing a similar number of 
objects. This allows us to probe the ellipticity dis¬ 
tribution in each S/N bin individually. With the 
high-S/N bin being least affected by the effects of 
the PSF, different intrinsic ellipticity distributions 
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can be distinguished. The low-S/N bin, which con¬ 
tains faint objects whose shape is dominated by 
the PSF, on the other hand allows us to test the 
properties of the PSF. 


We minimize Xred ^ fiducial configuration. For 

this first implementation, we choose to vary six simula¬ 
tion parameters to generate new samples describing the 
galaxy population, the image properties, and the noise 
level: the magnitude zero point of the image maqn , th e 
rms of the log-normal size distribution cr (Section 4.1), 


the rotation angle 9 between the magnitude and size 
plane and the plane where t he q uantities are approxi¬ 
mately uncorrelated (Section |4.1[ ), the r ms of the Gaus¬ 
sian background noise (Jn (Section 
the Gaussian distributions for the e' 


4.4), and the rms of 
lipticities 


and 


^2,rms (Eq.§. Those six parameters are not constrained 
by fits performed in B13. For each configuration an im¬ 
age is simulated and the x^^^-value is computed (Eq. . 

The Xred minimization procedure is designed to find 
a sensible parameter regime in a small number of itera¬ 
tions. It consists of two steps: First, we sample the pa¬ 
rameter space coarsely and identify the region in the pa¬ 
rameter space where the minimum Xred located. Then, 
by successive one-dimensional minimizations we find the 
minimum Xred- We vary each parameter while holding 
the others fixed and compute the new xled values. The 
specific parameter value that minimizes xled defines a 
new configuration. We repeat this step iteratively un¬ 
til it converges. The final result of the iteration is the 
fiducial configuration that is analyzed in the subsequent 
CLs. 

If Eq. I^can be applied, i.e. the quantities in each bin 
of the diagnostic distributions are Gaussian distributed, 
then confidence limits on the parameters can be com¬ 
puted. In this case, for a model with six degre es of free- 
dom the 95% confidence limits are given by (e.g. Ghernick 
k Eriis||200^ 


^Xled = 


1 




12.59. 


( 7 ) 


This gives for every parameter a range of values for which 
data and simulations are statistically consistent (see Ap¬ 
pendix). 


5.2. Control Loop 2 

The task of CL2 is to calibrate the shear measurement 
by comparing input and estimated shear signal on sim¬ 
ulated data. The image that we use to illustrate the 
MCCL framework is part of the DES SV-Al release, 
which covers about 200 deg^. The larger the area sim¬ 
ulated for calibration is, which needs to be larger than 
the size of the dataset, the more precise is the resulting 
calibration scheme. On the other hand however the com¬ 
putational costs increase for a larger area. We choose to 
simulate an area equivalent to 1000 deg^ for any given 
configuration. On the galaxies detected in those images 
we apply a S/N-cut of 15, where we define the S/N as 
SE’s FLUX_BEST/FLUXERR_BEST, and a size-cut 
of 1.2 times the PSF size using SE’s FLUX.RADIUS 
measurement. This allows us to select galaxies large and 
bright enough for calibration. 


We follow Rhodes et al. (2001) to first order to estimate 
the galaxy shear 


^ 2-(|e|^)’ 


( 8 ) 


where 


e = 


J( 1 J 22 + 2t J); 

J'li + T22 


(9) 


is the lensed ellipticity, and e the unlensed one. In the 
weak leasing limit we can approximate 


(|e|^) « (|ef). (10) 

We use SE’s X2WIN_IMAGE, Y2WIN_IMAGE, and 
XYWINTMAGE to measure the weighted quadrupole 
moments of the PSF-convolved image Jb. To linear or¬ 
der and ignoring weight function terms, the PSF can 
approximately be corrected for using 


— T' — p 


( 11 ) 


where Pij is the mean of the weighted quadrupole mo¬ 
ments of the stars. We use Jb = Jb in Eq. j^when PSF 
correction is not applied. 

The galaxies are then binned in input shear signal and 
the mean estimated shear is computed in every bin. We 
calibrate the shear measurement to first order by fitting 
and applying a linear correction 




( 12 ) 


where Xind is the input shear. 


5.3. Control Loop 3 

Knowing the ranges of parameter values for which data 
and simulations are statistically consistent from CLl, we 
can test the robustness of the calibration schemes for 
shear measurements for different configurations in this 
parameter space volume (CLS.l). We vary each param¬ 
eter in a range slightly larger than that allowed by the 
data, while keeping the other parameters fixed, and cal¬ 
ibrate the shear measurement on this new location in 


parameter space (see Section 5.2). We then explore by 
which amount the calibration (a and /?; see Eq. 12) 
changes relative to the calibration on the fiducial conng- 
uration resulting from applying CLl. This uncertainty in 
the shear calibration corresponds to the systematic error 
we expect in the shear measurement. 

The resulting multiplicative and additive biases (Eq. 
due to the uncertainty in the fiducial conhguration 
are computed by evaluating 


Aa,; 


and Cj = 


aa 


(13) 


where Aai and AA are the changes relative to the fidu¬ 
cial calibration parameters. We require and Ci to meet 
the targets set in Section otherwise the diagnostics 
themselves need to be refinM and additional tests could 
be required {CLS.2), affecting all the previous loops. 


6. RESULTS 
6.1. Control Loop 1 
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Figure 1. Comparison of a DES SV image (DES0441-4414 \ Isft) a- UFiG simulated image after CLl (right). A 4 arcmin^ segment 
of the total 0.5 deg^ images is shown. The same color scale has been applied to both images. 



Figure 2. Histogram of the pixel values in ADUs for DES0441- 
4414 (red) and a simulated UFiG image (blue) with the fiducial 
configuration after CLl. The solid lines show the counts of all the 
pixels in the image. SB’s segmentation map assigns pixels either 
to objects or the background. The dashed respectively dotted lines 
show the corresponding pixel counts. 

Excerpts of the DES0441-44M image and the UFiG 
image simulated with the fiducial configuration are dis¬ 
played in Fig. They apper similar visually. For a 
quantitative comparison, Figuresshow the diagnostic 
plots for the DES image and the UFiG image. The com¬ 
bined xled individual values for each diagnostic has 

a value of 1.06. Thus, the fiducial configuration we find is 
a good fit to the data in the chosen diagnostics. To avoid 
combining very different Xred values, we assure that the 
individual Xred values are also close to 1. For the fiducial 
configuration, the individual ones for each diagnostic are 
within \xred ~ ^ Appendix). By varying the 

binning scheme we have checked that we recover similar 
fiducial configurations and confidence limits. 

Fig. [2] shows the histograms of pixel values for all the 


pixels in both images (solid). The overall behavior agrees 
well {xled ~ 1-38). The histograms agree well around the 
peak, with the distribution of the pixels in the UFiG im¬ 
age being slightly broader. The pixels are furthermore 
divided using SE’s segmentation map into two sets to al¬ 
low us to understand differences and similarities better. 
One set contains all the pixels associated with identified 
objects (dashed), and the other those associated with 
the background (dotted). The histograms of pixels asso¬ 
ciated with objects agree well {xfed ~ 1-10). We however 
observe a low-level discrepancy in the background pixel 
histograms at high pixel values. While our noise model 
including Gaussian noise in every pixels seems to be a 
good approximation around the peak of the histogram, 
it does not account for the background pixels with larger 
positive pixel values. As the number of background pix¬ 
els is small compared to the total number of pixels with 
pixel values of > 30 ADUs, those differences do not affect 
the value of Xred significantly. 

Fig. displays the magnitude-size plane of objects 
identified by SE in both the simulation and the data. 
Overall, the distributions resemble each other qualita¬ 
tively and quantitatively (x^ed ~ 1.26). In particular, 
the main bulk of the galaxy distributions, the location 
of the stellar loci, and the saturation turnoffs all agree 
well. Some slight differences can however be noted. The 
dispersion around the stellar locus is larger in the DES 
image, which is due to our simple PSF model constant 
in size. Furthermore, the shapes of the density contour 
lines and the magnitude limits are slightly different. We 
believe that changes in the galaxy model would improve 
this. 

The different magnitude limits and the discrepancies in 
the background-only histograms of pixel values call for 
more noise in the simulations. Increasing the width of 
the Gaussian background would on the other hand how- 
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Figure 3. Distribution of r-band magnitudes (MAG_BEST) and the sizes in pixels (FLUX_RADIUS) of objects identified by SE. 
Isodensity contours of the number of objects track the shape of the distribution. Red is the DES0441-4414 blue is a simulated UFiG 
image with the fiducial configuration after CLl. Histograms on the right and the bottom show the projected distributions in different size 
and magnitude bins. The black marks denote the difference between the red and blue histograms in every bin. 


ever aggravate the discrepancy around the background 
peak. To resolve this tension (see Appendix), a more so¬ 
phisticated background model easing some of the simpli¬ 
fying assumptions on the properties of the backgro und is 


needed (for an overview of possible extensions see Rowe 


et al. 2014|). An analysis of the two-point correlation 


function will reveal structures in the background not yet 
modeled and will serve as an additional diagnostic. 

The ellipticity planes in the different magnitude bins 
are shown in Fig. Due to the ellipticity introduced 
by the PSF, the mean of the Ci-distributions is shifted 
towards positive values and thus there is a small asym¬ 
metry. Note that the galaxies we include in the cali¬ 
bration of the shear measurement are mainly in the two 
brighter magnitude bins where the distributions match 
well ixled ~ 1-35 and « 0.63). In the brightest 
magnitude bin, the distributions deviate slightly for val¬ 
ues of \ei\ > 0.3. We believe this is caused by our choice 
of the intrinsic ellipticity distributions being normal in 
Ci (see Eq. [^. Changes in the intrinsic ellipticity dis¬ 
tribution can improve the agreement between the data 
and the simulation. In the faintest magnitude bin, the 
distributions do not match well (x^ed ~ 0.21). As noted 


above, there seem to be more faint objects detected in 
the UFig image (about ^ 15% more detected objects in 
total). Furthermore, there are differences between the el¬ 
lipticity distributions in this bin. This can be attributed 
to the simple PSF model we choose, as the objects in 
this bin are mostly dominated by the PSF. As we apply 
a S/N-cut of 15 (corresponds to mag ~ 23), differences 
in the faintest magnitude are potentially not relevant for 
the calibration of the shear measurement. Nevertheless, 
it is only by looking at the results of a future, more rigor¬ 
ous MCCL analysis including parameters describing the 
PSF model that we can assess whether the differences in 
the faintest magnitude bin are relevant for shear mea¬ 
surement. 


6 .2. Control Loops 2 and 3 

We perform a tolerance a nalys is of the shear calibra¬ 
tion, as described in Secti on |5.3| We vary the same six 
parameters as in Section mago, cr, 0, crjy, ei^rms, 
and 62 ,rms- The allowed parameter ranges by the data 
are given by the analysis performed in Section 6.1 (see 
Appendix). They correspond to the 95% confidence lim¬ 
its we take as a measure of statistical consistency of dif- 
































































































Bruderer et al. 




Figure 4. Ellipticity distributions for objects identified by SE in DES0441-44^4 (red) and a simulated UFiG image with the fiducial 
configuration after CLl (blue) are shown. The objects are split up into three different r-band magnitude (MAG-BEST) bins, such that 
they contain approximately the same number of objects. In every bin, isodensity contours of identified objects in the ellipticity plane (see 
Eq. (top row) and the corresponding histograms (bottom row) are shown. 


Table 1 

Calibration coefficients on and /3i for the fiducial 
configuration 


Coefficient 

PSF-uncorrected 

PSF-corrected 

ai 

0.199 ±0.001 

0.380 ± 0.002 

0-2 

0.197 ± 0.001 

0.377 ± 0.002 


(4.40 ±0.01)- 10-3 

(0.82 ±0.02) • 10-3 

d2 

(2.86 ±0.01)- 10-3 

(1.10 ± 0.03) • 10-3 


ferent configurations. For each of these parameters, we 
compute the chan ge in calibration relative to the fiducial 
model (see Table at six different points around the 
fiducial configuration. For every data point we simulate 
an area of 1000 deg^. Thus, to calibrate the shear mea¬ 
surement with the precision required for 200 deg^ survey, 
we need to simulate 37000 deg^. 

Figures[^and[^show how uncertainties in the input pa¬ 
rameters result in multiplicative biases. We use the two 
shape measures described by Equations [8pT] We find 
that, for the six parameters we vary, the FSF-corrected 
shape measurement calibrated through the MCCL frame¬ 
work is robust enough for a DES SV-like 200 deg^ sur¬ 


vey in terms of the requirement described in Section 
As discussed in (Refregier & Amara|2014 1 unknown sys- 
tematics or effects not yet included in the simulations 
may affect the shear measurement. However, the MCCL 
approach provides a framework for testing aspects of 
the measurement process that are in doubt. The PSF- 
uncorrected shape measurement does not perform as well 
as the PSF-corrected one, and lies slightly outside the 
tolerance band in some parameters. To make statements 
about whether the calibration scheme is robust enough 
for a 5-year DES-like 5000 deg^-survey in the parameters 
varied, a larger area needs to be simulated to increase the 
accuracy of the calibration. Furthermore, as described in 
Section!^ achieving this new target requires refinements 
on the MCCL framework. 

Figuresand 1^ show the resulting additive biases. For 
the parameters considered, both shape measures already 
even satisfy the requirements for a full DES-like survey 
with 5 years worth of images. 

We find in this first tolerance analysis that the cali¬ 
bration of the shear measurement seems to depend sensi¬ 
tively on the intrinsic ellipticity distribution. While there 
is not a significant additive bias due to an uncertainty in 
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Figure 5. Multiplicative bias in the measurement of 71 as a function of different parameter values and different shear measurement 
methods. We simulate images equivalent to an area of 1000 deg^ for every configuration to calibrate the shear measurement. The change 
is relative to the central data point, our fiducial shear calibration. The vert ical blue bands show the range in parameter values data and 
simulations are statistically consistent (95% confidence limits) (see Section |4.1[ | . The horizontal gray bands correspond to the required 
accuracy in the shear measurement of a 200 deg^ (light gray) and 5000 deg survey for the measurement not to be systematics-limited. 
The star denotes the fiducial configuration. 



Figure 6 . Multiplicative bias in the measurement of 72 . Similar to Fig. 
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Figure 7. Additive bias in the measurement of 71 . Similar to Fig. 
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Figure 8. Additive bias in the measurement of 72 - Similar to Fig. 
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ei,rms and e 2 ,rms, the ellipticity distribution needs to be 
taken special care of such that no significant multiplica¬ 
tive bias is induced. The diagnostics likely need to be 
refined further to reduce this residual systematic effect 
such that stricter targets can be met in further MCCL 
analyses. 


7. CONCLUSION 

We have presented an ini tial implementation of th e 
Monte Carlo Control Loops (Refregier & Amara 2014), 
a novel approach for weak lensing shear measurements. 
The method contains a set of three Control Loops (CL) 
applied to data and image simulations to forward-model 
the shear measurement process. They are designed 
specifically to calibrate the shear measurement and test 
its robustness with the goal of reaching a certain sensi¬ 
tivity. The requirements in this paper are chosen such 
that the lensing measurement, assuming spatially invari¬ 
ant systematic errors, on the final dataset of a DES- and 
also DES SV-like imaging survey is not limited by sys¬ 
tematic errors, i.e. the systematic error of the measure¬ 
ment is smaller than the statistical error. 

The MCCL approach provides a consistent way of an¬ 
alyzing systematic errors in the measurement. It allows 
us to probe potential sources of error for their effect on 


the measurement, e.g. noise bias (Refregier et al. 2012 


Kacprzak e t al. 2012) and model bias (e.g. Kacprzak 
et al.| |2014[) , provided that they are included in the Sim¬ 
ons. R 


ulations. However, the simulation and analysis of a large 
number of images is essential in this approach. To not 
be limited computationally, every step in the CLs needs 
to be fast, especially the generation of images. This led 
to the developmen t of the Ultra Fast Image Generator 
(Berge et al. 2013), w hose speed is comparabl e to exe- 


1996), the im- 


cuting S Extractor (Bertin & Arnouts 
age analysis tool used in this paper. 

We present a first implementation of the MCCL frame¬ 
work using an image taken during the Science Verifica¬ 
tion (SV) phase of DES. For this purpose, we choose a 
spatially invariant PSF model, vary six simulation pa¬ 
rameters, and consider only one-point shear measure¬ 
ments. With these assumptions, we find that the im¬ 
age calibration achieves multiplicative and additive bi¬ 
ases within the needed weak lensing precision for a DES 
SV-like (200 deg^) survey, assuming them to be spatially 
invariant. We also find with the tolerance analysis that 
the shear measurement is very sensitive to the intrinsic 
ellipticity distribution. Furthermore, we find an inter¬ 
play between the magnitude-size and the histogram of 
pixel values diagnostics in fitting the noise level to the 
image. To accommodate both diagnostics, an extension 
of the Gaussian noise model will be implemented in fu¬ 
ture work. 

To achieve our goal of not being systematics-limited 
when measuring shear on a 5000 deg^ DES-like survey, 
several features in the MCCL framework need to be re¬ 
fined. First, we will incorporate more realistic instru¬ 
ment and noise model in the image simulations. Next, 
we like to extend this framework to include two-point 
functions in the analysis. In addition, we are planning to 
test the effects of a spatially varying PSF and other PSF 
models. We will also explore the effect of more complex 
galaxy models and non-uniform distributions of galax¬ 
ies on the calibration of the shear measurement. And 


finally, a more rigorous tolerance analysis varying more 
simulation parameters is required. 

The results we present in this work require the sim¬ 
ulation of about 40000 deg^ of images. From a simple 
extrapolation of this figure, the computational resources 
needed for the full 5-year DES data appear large. How¬ 
ever, several improvements on the framework can readily 
result in significant speed-ups. For example, better sam¬ 
pling strategies can in principle speed up the tolerance 
analysis in CL3.1 by orders of magnitude, which is by far 
the most computationally expensive step in this work. 
Furthermore, improvements in the diagnostics used in 
CLl will increase the discriminatory power between dif¬ 
ferent simulation configurations, reducing further the pa¬ 
rameter space one needs to sample, and thus the compu¬ 
tational time. 

All these improvements will pave the way to exploit the 
full potential of weak lensing through the understanding 
of systematic effects within the MCCL framework. 
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Figure 9. three different diagnostics as a function of different parameter values are shown. The star denotes the 

fiducial configur ation . The vertical blue bands are computed with Eq. [^and show the 95%-confidence limits. They correspond to the blue 
bands in Figures |5| 8 1 


APPENDIX 


REDUCED AS A FUNCTION OF DIFFERENT SIMULATION PARAMETERS 


As described in Section 5.1 we search for the hducial simulation configuration by minimizing the Xred dehned in Eq. 

In this Appendix, we describe in detail the minimization procedure and point out some features in the resulting 
Xred functions, which may indicate interesting physical insights to the data. 

For each of the six simulation parameters considered, we systematically vary its value around some initial guess and 
calculate xled while holding the other parameters hxed. The six parameter values that yield the minimum Xred 
then used for the next iteration and the process continues until it converges about the minimum. In this final set 
of parameters, the Xred values along each of the one-dimensional axes are shown in Fig. The blue shaded bands, 
which correspond to the blue bands in Figures [sM are the 95%-confidence limits for each of the parameters (see Eq. 
[^. Table lists the corresponding parameter vmues in the plots. 

To better understand how the various diagnostics affect the resulting y^^^-function, we split it up into the contri¬ 
butions of each diagnostic. For the fiducial configuration, which is denoted by a star, we find \xled ~ H <0-4 for all 


the individual diagnostics and their combined sum. The total Xred i® well approximated by quadratic fits, though Xred 
from individual diagnostics can show very different behaviors. Furthermore, the fiducial configuration is close to the 
minima of the quadratic fits. 

We want to point out a few features in the individual subfigures. First, the magnitude-size plane (see Fig. and 
the ellipticity plane (see Fig. 1^ do not react to changes in the magnitude zero point of the image (mago)- Only 
the histogram of pixel values ^ee Fig. responds to changes in mago, as the magnitude zero point affects the 
normalization of the pixel values. 

Second, when varying the width of the Gaussian background a^ , the histogram of pixel values and the magnitude- 
size plane respond in opposite directions. As described in Section [O] the fiducial model produces a slightly deeper 
image compared to data. Thus, the magnitude-size plane is pushing for a higher noise level. The histogram of pixel 
values however constrains the background peak in the sky-subtracted image and cannot accommodate larger values. 
Therefore, we believe that including an additional Non-Gaussian noise term can reconcile the tension. 

Third, the diagnostics are rather flat if ei^rms and 62 ,rms are varied. As a result, the 95%-confidence limits for this 
parameter are relatively wide. Another less noisy diagnostic to constrain the ellipticity distribution might shrink these 
conhdence limits. 
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Table 2 

Minimum and 95%-confidence limits of the quadratic fits (Fig. and parameter values for the fiducial 

configuration 


Parameter 

Fiducial value 

Central value 

95% CL 

Description 


mago 

30.565 

30.576 

±0.055 

Magnitude zero point 


CTJV 

5.10 

5.17 

±0.34 

rms of the background noise 



0.383 

0.396 

±0.045 

rms of the intrinsic ei distribution 


^2,rms 

0.407 

0.387 

±0.041 

rms of the intrinsic 62 distribution 


(J 

0.2422 

0.2381 

±0.0390 

rms of the intrinsic log-normal size 

distribution 

e 

0.1382 

0.1370 

±0.0068 

Rotation angle to plane intrinsic 
sizes are uncorrelated 

magnitudes and 


Fourth, the X^ed values of the ellipticity diagnostic are below 1 in the relevant parameter ranges. As the quotient in 
Eq. I^is dominated by the error estimated on the data (Jd^ij , this behavior of the ellipticity diagnostics suggests issues 
in e^imating the scatter of the dataset. 

Finally, the magnitude-size plane is the most sensitive diagnostic to changes in the magnitude and size distribution 
parameters a and 9 of the galaxy population. Hence, the combined x^g,^-curve is mostly driven by this diagnostic. 






